SynFace—Speech-Driven Facial Animation for Virtual Speech-Reading Support

SynFace - Speech-Driven Facial Animation for Virtual Speech-Reading Support

This paper describes SynFace, a supportive technology that aims at enhancing audio-based spoken communication in adverse acoustic conditions by providing the missing visual information in the form of an animated talking head. Firstly, we describe the system architecture, consisting of a 3D animated face model controlled from the speech input by a specifically optimised phonetic recogniser. Seco...

Speech-driven 3d facial animation for mobile entertainment

This paper presents an entertainment-oriented application for mobile service, which generates customized speech-driven 3D facial animation and delivers to end-user by MMS (Multimedia Messaging Service). Some important methods of this application are discussed, including the 3D facial model based on 3 photos, the 3D facial animation driven by speech or text on-line and the video format transform...

Speech Driven MPEG-4 Facial Animation for Turkish

In this study, a system, that generates visual speech by synthesizing 3D face points, has been implemented. The synthesized face points drive MPEG-4 facial animation. To produce realistic and natural speech animation, a codebook based technique, which is trained with audio-visual data from a speaker, was employed. An audio-visual speech database was created using a 3D facial motion capture syst...

Automated Speech Driven Lipsynch Facial Animation for Turkish

An MPEG-4 Facial Animation System Driven by Synthetic Speech

This paper’ provides an overview o f the act iv i t ies that have led to the development o f a prototype appl icat ion o f a “talking head” compliant with MPEG-4 spectfication. The work done so far Jits in the context of one of the recent work-i tems def ined by the ISOBEC JTCI/SC29/WGll world-wide known as MPEG. This IS0 Working Group is now in the process o f de f in ing a uni fy ing framewor...